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DaimlerChrysler AG 

METHOD FOR INFORMATIVE SUPPORT OF A VEHICLE DRIVER 
BY A VEHICLE MULTIMEDIA SYSTEM 

This invention relates to a method for informative support of a vehicle driver by a vehicle 
multimedia system according to the preamble of Claim 1. Such a vehicle multimedia system 
offers the driver of a vehicle information and accounting options, e.g., access to address 
management, trip navigation and Internet access. 

Multimedia systems are increasingly a part of modern vehicles. Although today's users are 
accustomed to using multimedia systems, with the constantly growing flood of information, the 
selection of information that is of actual interest for the user is becoming increasingly complex. 
Another problem with a vehicle is that use is limited for ergonomic reasons, because safe driving 
of the vehicle must always have priority. 

European Patent EP 1 143 679 A2 describes a multimedia system in which an external computer 
adapts requested data individually to a requesting computer, with a multitude of types of 
presentation of data being provided. No special support for the driver of the vehicle is provided. 

German Utility Model DE 200 16 746 Ul discloses a multimedia system in which an external 
computer dynamically links data from various databases and supplies it to a requesting computer 
for retrieval. No special support is provided for the driver of a vehicle in this case either. 
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WO01 22712 Al discloses a method for remote configuration of a multimedia device in a 
vehicle. Spontaneous information requests by the driver of a vehicle while driving cannot be 
processed with this system. 

German Patent DE 100 24 007 Al, which defines the genre, presents a vehicle multimedia 
system in which destination data for trip navigation is edited on the user's home computer, 
transferred to an external computer and transmitted by wireless transfer from the external 
computer to the vehicle. Spontaneous information requests by the driver of a vehicle while 
driving cannot be processed here, either. 

The object of this invention is to provide a method for informative support of a vehicle driver 
which will allow a change and request of information at any time while driving inexpensively, 
conveniently and rapidly while at the same time ensuring safe driving of the vehicle. 

This object is achieved according to this invention by the features of Claim 1. The subclaims 
pertain to advantageous embodiments and refinements of the invention. 

The main idea of the invention is that special memory areas are provided in the vehicle computer 
and in the external computer, and the contents of these memory areas characterize elements of a 
supply of information that is available to and selectable by the driver of the vehicle by means of 
the vehicle media system. The contents of these special memory areas can be altered by the 
driver of the vehicle through an input mode that does not have a negative effect on driving 
safety, and the contents of these special memory areas are automatically compared in the vehicle 
computer and in the external computer. In other words, the vehicle multimedia system has a 
variable vehicle-dependent information supply, which is known in both the vehicle computer and 
in the external computer. Information supply here does not mean that the corresponding 
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information is already in the vehicle computer and/or in the external computer. Instead, 
information supply means an "index" of a limited quantity of information that can be accessed 
by the driver of the vehicle. Access to information is then accomplished by selecting the proper 
element. 

This method has several advantages at the same time. For example, the driver of the vehicle is 
informed at any time rapidly, directly and in a cost-neutral manner regarding such an available 
information supply without first having to establish a billable and time-consuming connection to 
an external computer. In addition, this method ensures in a particularly simple manner a 
connection to and use of systems already present in the vehicle and also provides them with an 
information supply available in this way and likewise accessible. A particularly convenient 
operation which supports driving safety is also ensured due to the possibility of making changes 
in an input mode without any negative effect on driving safety. Thus an information supply that 
is tailored to the wishes of the driver is made available to the driver of the vehicle in an ideal 
manner and the driver can change this information easily at any time. Furthermore, the fact that 
previous changes can be documented and thus can be retrieved again due to the fact that an 
available information supply is stored in the vehicle computer and in the external computer has a 
cost-saving effect; monitoring of an information supply that is already on hand makes it easy to 
detect unnecessary processes and multiple changes in an information supply can be collected and 
transmitted from the external computer to the vehicle computer. 

An input mode for changing the contents of the special memory areas in a manner that does not 
impair driving safety is in particular voice input by the driver of the vehicle. Additionally or 
alternatively, a special manual operation is provided. 
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In this advantageous embodiment, the voice input by the driver of the vehicle for altering the 
contents of the special memory areas is processed by the external computer. This permits a 
particularly rapid and thorough processing of the voice input because the external computer has a 
much greater computation power and also has additional means in comparison with the vehicle 
computer. Transfer of voice input by the driver of the vehicle to the external computer can 
therefore be accomplished, e.g., in voice form ("telephony") or in data form. 

It is particularly advantageous if the processing by the external computer is performed by 
including a human operator. A human operator can check the information content of an element 
in a targeted manner before this element is added to an information supply which is made 
available to the driver of the vehicle by means of the vehicle multimedia system. For example, 
the human operator may select exactly one from an automatically generated list of multiple 
possible elements. The human operator may also in ambiguous cases act in a supportive and 
advising capacity. In a particularly simple manner, this accomplishes the fact that the driver of 
the vehicle is employed as little as possible with providing an element of the information supply, 
which ensures convenience and traffic safety. 

Another input mode for altering the contents of the special memory areas in a manner that does 
not interfere with driving safety is to have the change performed by the front-seat passenger 
and/or by a passenger in the rear. Therefore this invention can also be used in a particularly 
flexible manner. The changes may be performed, for example, even according to specifications 
by the driver of the vehicle. The changes are performed by the front-seat passenger and/or the 
rear passengers, e.g., by voice input and/or manual operation. 
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It is advantageously proposed that the comparison of the contents of the special memory areas 
(i.e., between the vehicle computer and external computer) be performed according to various 
criteria, whereby different parts of the contents of the special memory areas may also be 
compared according to different criteria. The comparison may be performed automatically after 
being triggered by the driver of the vehicle, e.g., by triggering of an operating element, or it may 
be event-controlled, e.g., in starting up the vehicle or when activating the communication device 
in the vehicle, time-controlled or controlled by the external computer. Of course any 
combination of these options may also be provided. In determining a criterion, for example, the 
importance, the cost generated and/or the urgency of an element of the information supplied are 
to be taken into account, and these criteria may also be determined by the driver of the vehicle. 

In an advantageous embodiment, an element to be removed from the information supply of the 
vehicle multimedia system is not deleted from the special memory areas but instead is provided 
with a special identifier. This identifier is responsible for nonavailability of this element for the 
vehicle multimedia system. This sub-aspect illustrates again clearly the advantageous effects of 
the inventive method, because elements of the information supply once made available by means 
of the vehicle multimedia system can in this way be "reactivated" in a manner that minimizes 
cost, time and effort by merely deleting this special identifier and making this element available 
again for the vehicle multimedia system. 

Convenience and traffic safety are further increased if an element is selected from the 
information supply available by means of the multimedia system for access to corresponding 
information, this selection being made by voice input by the driver of the vehicle. Since this 
involves only a relatively small extent of voice commands, it is possible to provide for the voice 
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input to be processed by the vehicle computer. Alternatively or additionally, e.g., in the case of 
voice input that is difficult to understand, processing on the external computer may be provided. 

Another sub-aspect also illustrates again convincingly the advantageous nature of the inventive 
method. To implement this sub-aspect, a navigation means which is autonomous within the 
vehicle and is designed, e.g., as part of the vehicle computer is provided. Geographic positions 
pertaining to an element of the information supply available to the driver of the vehicle by means 
of the vehicle multimedia system are converted with their first use by the navigation means into 
navigation-means-specific coordinates which are stored in such a way that they are associated 
with the element. In this way, the complex conversion of the geographic coordinates of the origin 
is performed by the vehicle-specific navigation means; these original coordinates are provided to 
the navigation means after access to the information and are converted into coordinates to be 
used by the vehicle-specific navigation means only at the time of the initial access. After this 
conversion with the initial access, these navigation means-specific coordinates are stored in such 
a way that they are also available in the event of renewed selection of the specific element of an 
information supply available to the driver of the vehicle by means of the vehicle multimedia 
system. To do so, for example, a portion of the special memory area is provided for this purpose. 
In all subsequent retrievals, the navigation system is triggered directly with the navigation- 
means-specific coordinates and renewed complex conversion of coordinates is omitted. 

The vehicle computer and the external computer advantageously use a wireless network for 
bidirectional communication. Modern wireless networks offer platforms on which the inventive 
method can be implemented at reasonable expense using transmission techniques such as GPRS 
(General Packet Radio Service) or WAP (Wireless Application Protocol). 
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It is advantageous if the vehicle computer can additionally also be used for access to an 
information supply available outside of the vehicle multimedia system. This information supply 
may also be personalized, e.g., by an intelligent preselection according to user preferences. This 
"free" information access (i.e., access that can be performed outside of elements of the 
information supply available to and selectable by the driver of the vehicle by means of the 
vehicle multimedia system) eliminates in the individual case access to the external computer 
when it is already known precisely to the driver of the vehicle which information he would like 
to access, e.g., a WAP address. 

In another advantageous embodiment, a device is provided for recognizing the driver of a 
vehicle, a e.g., a chip card or a biometric identification. Thus the vehicle multimedia system 
makes the information supply available on a personalized basis, e.g., when a vehicle is frequently 
used by different drivers and/or when a driver frequently uses different vehicles. Other 
possibilities for personalization includes specific vehicle keys (the driver of the vehicle is 
identified in the vehicle on the basis of the vehicle key used) or specific calling numbers (the 
driver of the vehicle is identified on the part of the external computer, e.g., on the basis of the 
calling number of the cell phone used). 

According to another embodiment, to alter the contents of the special memory areas, additional 
means and/or access possibilities are provided, e.g., a mobile device (PDA, personal digital 
assistant), thus ensuring universal operability. 

This invention is preferably implemented as a computer program having program code means, 
whereby a respective embodiment of the inventive method is implemented when the respective 
program is executed on a computer. 
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Another preferred form of implementation of the invention is a computer program product 
having program code means, whereby the program code means are stored on a computer- 
readable data medium to implement a respective embodiment of the inventive method when the 
respective program product is executed on a computer. 

A preferred embodiment of this invention will now be illustrated in greater detail on the basis of 
a drawing, in which: 

FIG 1 shows a flow chart for implementing changes in the contents of an information 
supply available to the driver of the vehicle by means of the vehicle multimedia 
system ("device"), 

FIG 2 shows a flow chart of the selection of elements of an information supply available to 
the driver of a vehicle by means of the vehicle multimedia system together with its 
vehicle connection ("use"). 

FIG 1 illustrates the sequences that occur when there are changes in the contents of an 
information supply available to the driver of the vehicle by means of the vehicle multimedia 
system. Beginning with the start 10, this provides for an authorization 20, a configuration 30, a 
voice-controlled configuration 40, a manual element deletion 50 and an external processing 60, 
with various processing steps being run through. In each case, an automatic safety mechanism 70 
is used before data is stored in the vehicle computer and the end of processing 90 is reached. The 
end of processing 90 includes at least one proper termination of the existing communication link 
between the vehicle computer and external computer and an assignment of the costs incurred to 
the driver of the vehicle. The automatic safety mechanism 70 ensures that in no case will 
unwanted, unsuitable and/or maliciously altered data reach the vehicle. This important step thus 
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ensures access of data to the vehicle and reliably ensures that the inventive method can in no 
case lead to a situation that is critical for the safety and/or functioning of the vehicle. To rule out 
the possibility of such a critical situation which might occur with so-called hacker attacks, for 
example, suitable encryption and identification methods are provided with the automatic safety 
mechanism 70. 

The authorization 20 serves to ensure bidirectional communication between the vehicle computer 
and the external computer. The authorization 20 is neither triggered by the driver of the vehicle 
nor is he involved in its processing. Instead, the authorization 20 is triggered by the external 
computer and/or by a human operator of the external computer. The triggering occurs, for 
example, when there are planned changes in telephone numbers or parameters which are used in 
bidirectional communication between the vehicle computer and the external computer. As a rule, 
such changes occur only very rarely. After being triggered 21, the data and parameter list 22 
needed to ensure bidirectional communication between the vehicle computer and the external 
computer is transmitted to the vehicle after running through the automatic safety mechanism 70. 
In the vehicle, a corresponding data and parameter conversion 23 is then performed on the 
vehicle multimedia system with this data and parameter list 22. 

The configuration 30 combines all possibilities of changes which can be performed by the driver 
of the vehicle on the elements of an information supply available to the driver of the vehicle by 
means of the vehicle multimedia system. 

The voice-controlled configuration 40 begins with voice input 41 by the driver of the vehicle, 
which may be followed by automatic user identification 42 if such identification has not already 
occurred. For example, when using a wireless network for transmission of the voice input to the 
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external computer, this automatic user identification 42 is accomplished by checking the SIM 
(subscriber identification module, user-specific chip card). After user identification 42, either a 
human operator 43 or an automatic voice recognition system 44 is used for processing the voice 
input by the driver of the vehicle. Which of these two possibilities is selected will depend, for 
example, on the type of change requested by the driver of the vehicle or on a preselection made 
by the driver of the vehicle. A switch may of course also be performed during a voice-controlled 
configuration. The human operator 43 or the automatic voice recognition system 44 triggers an 
addition, modification or deletion of content 45 in the special memory area in the external 
computer. Depending on the type of automatic comparison of contents of the special memory 
area in the external computer with the special memory area in the vehicle computer, the 
comparison is then performed after running through the automatic safety mechanism 70, i.e., the 
data is transferred to the vehicle. 

The external processing 60 permits addition, modification or deletion of the contents 62 in the 
special memory area in the external computer directly via a safety mechanism 61. The safety 
mechanism 61 ensures that only authorized external processing is performed. The external 
processing may be performed, for example, on a home computer which is connected to the 
external computer via a communication network (Internet) or via a mobile device (PDA, 
personal digital assistant) which establishes a radio connection to the external computer via a 
wireless network. Depending on the form of external processing selected, a suitable safety 
mechanism 61 is provided in each case. In the case of a home computer, this is accomplished by 
using a password, for example; in the case of a mobile device it is accomplished, e.g., by 
checking the SIM (subscriber identification module, user-specific chip card). Again, the 
comparison is performed depending on the type of selected automatic comparison of the contents 
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of the special memory area in the external computer with the special memory area in the vehicle 
computer after running through the automatic safety mechanism 70, i.e., the data is transferred to 
the vehicle. 

Different criteria are provided for automatic comparison of the contents of the special memory 
areas in the vehicle computer and the external computer. For example, it is possible to provide 
for only a portion of the contents to be compared, e.g., that portion corresponding to an element 
of an information supply available to the driver of the vehicle by means of the vehicle 
multimedia system. A comparison may be performed after being triggered by the driver of the 
vehicle. The driver of the vehicle performs this triggering autonomously, for example, or the 
driver is informed in this way by a suitable notice that a change has been made in the special 
memory area on the external computer, so that only a very small volume of data need be 
transmitted to the vehicle computer. In addition, a comparison may be performed on an event- 
controlled basis, e.g., when starting the vehicle or in the case when the demands on the driver are 
anticipated to be low. Likewise, it is possible to provide for the comparison to be performed in a 
time-controlled manner, e.g., at certain intervals or at a certain time of day. It is also possible to 
provide for the comparison to be triggered in a manner controlled by the external computer 
and/or by its human operator. 

This is provided, for example, when certain conditions preselected by the driver of the vehicle 
occur. When using standardized wireless networks such as GPRS (General Packet Radio 
Service) or UMTS (Unified Mobile Telephone System), these comparison mechanisms are to be 
implemented by using techniques provided for in these standards (e.g., using so-called push 
channels) with a reasonable complexity. 
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After automatic comparison of contents of the special memory areas in the vehicle computer and 
the externa! computer, the data 46, 63 is also available in the vehicle computer in the same form 
as in the external computer. This data characterizes elements of an information supply 80 
available to the driver of the vehicle by means of the vehicle multimedia system after the data 
has been input into the vehicle computer. 

The manual element deletion 50 makes it possible for the driver of the vehicle to manually delete 
individual elements of an information supply available to the driver of the vehicle by means of 
the vehicle multimedia system. This is appropriate in particular when the driver of the vehicle 
already knows exactly which element he would like to delete. In this case it is not necessary to 
first establish a connection to the external computer. Instead, this element is manually deleted in 
the special memory area of the vehicle computer by an operating step 5 1 . The operating step 5 1 
is triggered, for example, by actuation of an operating element or by voice input. After this step 
and after a comparison of contents of the special memory areas in the vehicle computer and the 
external computer as explained above and after running through the automatic safety mechanism 
70, the corresponding data 52 is sent from the vehicle to the external computer, where it causes 
contents 53 in the special memory area in the external computer to be added, altered or deleted. 
After this comparison, the data in the special memory areas in the vehicle computer and in the 
external computer characterizes contents of elements of an information supply 80 available to the 
driver of the vehicle by means of the vehicle multimedia system. 

FIG 2 shows the sequences occurring in the selection of elements of an information supply 

available to the driver of a vehicle by means of the vehicle multimedia system together with their 

vehicle connection. The driver of the vehicle makes a selection from the elements and then the 

information assigned to an element is made available to the driver of the vehicle and/or other 
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systems by way of the vehicle connections. The vehicle multimedia system thus uses the 
bidirectional communication link between the vehicle computer and the external computer. 
Beginning with the start 10, a voice input 1 1 and a data request 12 by the driver of the vehicle 
are provided. 

The data request 12 is made by selection 13 of an element of an information supply available to 
the driver of the vehicle by means of the vehicle multimedia system. For this selection, e.g., a 
touch screen on which information characterizing an element is displayed and can be selected by 
the driver of the vehicle touching the screen, a vehicle-supported voice input or a manual 
operating element are provided. Since the elements of the information supply available to the 
driver of the vehicle by means of the vehicle multimedia system are stored in the special memory 
area of the vehicle computer, this step 13 does not require a billable connection to the external 
computer. Only after making a selection 13 of an element is a connection 14 to the external 
computer established. Then the information 15 belonging to the selected element is loaded into 
the vehicle by using the external computer. This information 15 need not be available in the 
external computer but instead may be requested by it, e.g., from databases or networks (Internet). 
The word "information" here is to be understood in the broadest sense. For example, it may 
include text, images, addresses or voice messages. After complete transfer of the information, the 
connection is terminated 16 between the vehicle computer and the external computer and the 
information is made available 17 to the driver of the vehicle. 

Making available 17 the information for the driver of the vehicle includes a number of 

possibilities, some of which are performed in response to explicit requests by the user but others 

are also performed automatically. In any case, it is provided that the driver of the vehicle will be 

notified, e.g., by acoustic or optical methods, of the fact that the information has been 
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successfully made available to an element of an information supply available to the driver of the 
vehicle by means of the vehicle multimedia system. 

The voice input 1 1 by the driver of the vehicle is processed either using 200 a human operator or 
by using 100 an automatic voice recognition system. Which of these two options is selected will 
depend, for example, on the selected element of an information supply available to the driver of a 
vehicle by means of the vehicle multimedia system or on a preselection made by the driver of the 
vehicle. It is of course also possible to switch between the two options during a voice-activated 
communication link between the vehicle computer and the external computer. 

When using 200 a human operator, a voice link 201 to this human operator is established. This 
voice link may be provided, e.g., as a traditional voice connection or as a data connection (voice 
over IP, voice communication in data format). The human operator may be provided, for 
example, in the case of the external computer or in a corresponding call center, which is 
connected to the external computer via a data network, for example. The exchange 202 between 
the human operator and the driver of the vehicle may consist, for example, of a question-and- 
answer dialogue, a request for special advice or a direct inquiry for desired information. When 
using 100 an automatic voice recognition system, an essentially analog sequence is provided. 
However, the exchange 1 02 between the automatic voice recognition system and the driver of 
the vehicle will not permit such complex inquiries and responses as when using a human 
operator, depending on the voice recognition system used. 

Depending on the sequence of the exchange 102 and/or 202, this exchange is followed by 
different steps. For example, the information 1 provided in the exchange may already be 
sufficient for the driver of the vehicle, so this is followed by the end of processing 90. The end of 
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processing 90 here includes at least one proper termination of the existing communication link 
between the vehicle computer and the external computer as well as assignment of the costs 
thereby incurred to the driver of the vehicle. 

It is also possible to transfer coordinate data 7 for the navigation device in the vehicle. This 
coordinate data 7 may be transmitted, e.g., following the exchange 102 and/or 202 to the vehicle 
via the existing communications link. The end of processing 90 follows the triggering 2 of the 
navigation device with the transmitted coordinate data 7 for navigation using this coordinate 
data. 

In another case, the instruction 8 to select an element of an information supply available to the 
driver of the vehicle by means of the vehicle multimedia system is given to the driver of the 
vehicle in the course of the exchange 102 and/or 202. Then the existing communication link 
between the vehicle computer and the external computer can be used for the subsequent 
processing steps which were explained above. 

The precise details of the bidirectional communication between the vehicle computer and the 
external computer will not be described further here because those skilled in the art are aware of 
them. This pertains, for example, to combining different transmissions of information in a single 
connection process, handling transmission errors and aborted connections and the low-priority 
handling of the connection process from the vehicle end. 

After providing 17 the information for the driver of the vehicle, a selection 9 is made as to how 
the information thus made available is to be processed further. This selection 9 is made directly 
by the driver of the vehicle or it is made as an automatic selection, depending on the 
specifications by the driver of the vehicle, for example, or the type and extent of the information 
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made available. For the case when coordinate data for the navigation device in the vehicle is part 
of the information transmitted, with this data the navigation device is triggered 2 and the vehicle 
is navigated with this coordinate data, e.g., on request by the driver of the vehicle or 
automatically. If the information includes text elements, machine conversion 3 of these text 
elements into a synthetic speech output (text to speech) is then provided, depending on the extent 
of the text elements, for example, or on specifications by the driver of the vehicle. For the case 
when the information includes image elements such as photographs or graphics, the information 
may be displayed on display units in the vehicle, e.g., a display screen, again depending on the 
extent of the image elements or on specifications by the driver of the vehicle, for example. In 
addition, it is provided that special components of the information may be sent for use by 
systems already in the vehicle. Examples that can be mentioned here include supplying address 
data to an address management system assigned to the vehicle computer, transfer of telephone 
numbers to the telephone number memory of the vehicle telephone and processing of email 
within the vehicle. Any combinations are possible here, depending on specifications by the 
driver of the vehicle and the vehicle equipment, for example. In any case, the end of processing 
90 then follows with all the processing operations described before. In special cases 5, in which 
no other steps are necessary after providing 17 the information, the end of processing 90 is 
triggered directly. Such a case may be, for example, an autonomous selection of an element by 
the driver of the vehicle from the information supply available by means of the vehicle 
multimedia system through the driver of the vehicle; no new information that is of interest for the 
driver of the vehicle is obtained from this information supply. 
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